Express mail: WB89016350US 
SONI-6700 [50P4 1 20] PATENT 

-1- 

EMBEDDED E-MARKER AND COMMUNICATION SYSTEM 



Inventor: Yuichiro Deguchi 

2201 Bridgepointe Parkway, #C344 
San Mateo, CA 94404 

Citizen of Japan 



FIELD OF THE INVENTION 
The present invention relates to portable electronic music marker 
devices. More particularly, the present invention relates to electronic music 
marker integrated device communication system, 

BACKGROUND OF THE INVENTION 
With increase in portable electronic devices such as personal digital 
assistants (PDAs), WAP (Wireless Application Protocol) enabled mobile 
telephones, i-mode mobile telephones, multi-functional portable radio CD 
(Compact Disc) players, MD (Mini Disc) players and MPS music players, there 
has been a steady increase in these types of devices capable of performing more 
operations. 

Sony Corporation and its U.S. subsidiary, Sony Electronics, Inc., 
introduced an electronic music marker device which is capable of 
"bookmarking" a music clip while being played on a radio and is capable of 
recalling the information related to the bookmarked music clip such as the name 
of the song, the artist, the album containing the song and so on. Using the 
electronic music marker device, a user can conveniently access the music clip 
information that the user listened to on the radio at a later time without the need 
to memorize the information or wait hopefully for the disc jockey on the radio 
to provide that information. In this manner, if the user wants to, for example, 
purchase the music album which the user has marked using the electronic music 
marker device, the user can easily identify the necessary information related to 
the marked music clip from the e-marks provided by the electronic music 
marker device. 
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While the electronic music marker device is introduced as a portable 
device which can easily be attached to a user's key chain, worn around a user's 
neck or attached to the strap of a user's bag for ready and convenient access, it 
would be desirable to incorporate the functionality of the electronic music 
marker device into existing electronic devices. Moreover, it would be desirable 
to have a communication system which includes electronic devices integrated 
with electronic music marker device functionality that are capable of wireless 
communication with network devices such as internet access enabled mobile 
telephone and the like, which in tum, may be configured to transmit the 
bookmarked data to the electronic music marker device server terminal. 
Furthermore, it would be desirable to allow the user to be able to access 
information related to the bookmarked data from a user terminal without the 
need to retransmit the bookmarked data to the server terminal. 




SUMMARY OF THE INVENTION 

In view of the foregoing, a marker integrated device communication 
system includes a data marker integrated device configured to store one or more 
data marks, a network device configured to establish wireless communication 
with the data marker integrated device to receive the one or more data marks 
from the data marker integrated device, and a server terminal configured to 
connect to the network device for data communication. 

A method of another embodiment includes receiving one or more stored 
data marks via a wireless communication path, establishing a connection to a 
server terminal, and transmitting the received one or more data marks using the 
established connection. 

A method of a fiorther embodiment includes storing a data mark, 
transmitting the stored data mark via a Bluetooth protocol connection, receiving 
the transmitted data mark, and transmitting the received data mark via a 
wireless connection. 

A data marker integrated device communication system of still another 
embodiment includes means for receiving one or more stored data marks via a 
wireless communication path, means for establishing a connection to a server 
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terminal, and means for transmitting the received one or more data marks using 
the estabHshed connection. 

A data marker integrated device communication system of yet still 
another embodiment includes means for storing a data mark, means for 
transmitting the stored data mark via a Bluetooth protocol connection, means 
for receiving the transmitted data mark, and means for transmitting the received 
data mark via a wireless connection. 

These and other features and advantages of the present invention will be 
understood upon consideration of the following detailed description of the 
invention and the accompanying drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 illustrates one embodiment of an overall embedded data marker 

device communication system; 

Figure 2 illustrates one embodiment of a marker integrated device of 

Figure 1; 

Figure 3 illustrates one embodiment of a network device of Figure 1; 

Figure 4 illustrates one embodiment of a server terminal of Figure 1 ; 

Figure 5 is a flowchart for illustrating one embodiment of the embedded 
electronic music marker device communication system operation; 

Figure 6 is a flowchart for illustrating another embodiment of the 
embedded electronic music marker device commxinication system operation; 
and 

Figure 7 is a flowchart for illustrating yet another embodiment of the 
embedded electronic music marker device commxmication system operation. 

DETAILED DESCRIPTION 
Figure 1 illustrates one embodiment of an overall embedded data marker 
device communication system. Referring to Figure 1 , embedded data marker 
device communication system 100 includes marker integrated device 101 
configured to communicate with network device 1 02 via a local wireless 
connection 106 under communication protocol such as Bluetooth protocol. 
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Further shown in Figure 1 are server terminal 1 03 configured to communicate 
with network device via connection 107. Server terminal 103 is further 
configured to communicate with user terminal 1 05 as shown via data network 
104. 

In one aspect, marker integrated device 101 includes an integrated 
Bluetooth conmiunication port for communicating with other devices which are 
Bluetooth protocol communication enabled. Likewise, network device 102 
includes an integrated Bluetooth communication port for communicating with 
device such as marker integrated device 101 for data transfer. As shown, 
connection 1 06 includes a short range wireless communication path between 
marker integrated device 101 and network device 102. In one embodiment, 
marker integrated device 101 may include automobile radio, a portable 
electronic devices such as Walkman®, MD® player. MP3 player each of which 
have incorporated and integrated therein the functionality of electronic data 
marker device. Additional detailed information relating to the operation of the 
electronic music marker devices can be found in pending application no. 
09/126,007 filed on July 29, 1998 and application no. 09/401,105 filed on 
September 22, 1999, both assigned to Sony Corporation, joint-assignee of the 
present application with Sony Electronics, Inc., a subsidiary of Sony 
Corporation, the disclosures of each of which are herein incorporated in their 
entirely by reference for all purposes. 

Referring back to Figure 1, network device 102 in one embodiment may 
include Wireless Application Protocol (WAP) enabled mobile telephones, i- 
mode telephones, intemet access enabled personal digital assistants (PDAs), and 
the like, each of which is capable of establishing intemet connection protocol 
for data transfer. Additionally, network device 1 02 is configured with an 
integrated Bluetooth communication port for communicating with marker 
integrated device 101. 

Server terminal 103 shown in Figure 1 may be configured to 
communicate with network device 1 02 via wireless connection 1 07 for data 
transfer, and may operate, for example, at communication speeds such as 56 
Kbps (similar to a wired dialup modem connection) or higher such as that 
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available from Ricochet® devices from which allow PDAs to establish wireless 
communication for connection to the intemet at speeds exceeding 56 Kbps, 

In this manner, network device 102 may be configured to receive data 
from marker integrated device 101 such as user inputted data marks and marker 
device identification code for the user via the wireless Bluetooth connection 
106, for example, and to transmit the received data via wireless connection 107 
to server terminal 103. 

Referring back to Figure 1 , data network 1 04 may include an IP network 
configured to connect server terminal 1 03 to user terminal 1 05 using protocols 
such as TCP/IP, Appletalk and the like. User terminal 105 may include a 
personal desktop computer, a portable laptop computer, an intemet appliance 
with intemet access capability, and the like. Moreover, user terminal 105 may 
be connected to server terminal 103 via data network 104 using one of a dialup 
modem connection, a DSL modem connection, a cable modem connection, and 
a wireless modem connection, each offering varying connection speeds for data 
upload and download. 

Figure 2 illustrates one embodiment of a marker integrated device of 
Figure 1. Referring to Figure 2, marker integrated device 101 includes memory 
201 such as a Random Access Memory (RAM) and a Read-Only Memory 
(ROM), and stored thereon is a unique device identification code 202 which can 
include a predetermined combination of letters or numbers, or a combination of 
both. In one embodiment, identification code 202 can include a thirteen-digit 
number which is unique to each bookmarking device and is pre-stored in the 
ROM portion of memory 201. 

Further shown in Figure 2 is controller (CPU) 204 which is configured 
to control the various components of marker integrated device 101 as related to 
the data marking device frmctionality such as display unit 207, input units 
203 A, 203B data marking buttons for bookmarking broadcast music clips over a 
registered radio or television station, or for bookmarking locations, input/output 
(I/O) interface unit 205, clock/timer 206, and memory 201 . In one aspect, 
display unit 207 and timer/clock 206 of marker integrated device 101 may be 
the corresponding display terminal and clock unit, respectively, of the marker 
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integrated device. For example, in the case of an automobile radio with data 
marker integrated therein as marker integrated device 101, display unit 207 may 
be integrated with the existing display panel of the automobile radio, and 
timer/clock 206 may be integrated with the existing radio clock in the device 
101. 

Referring back to Figure 2, I/O interface unit 205 of marker integrated 
device 101 may include a Bluetooth communication port for wireless data 
communication which is a radio frequency standard operating at 2.4 GHz for 
short range wireless communication. More specifically, I/O interface unit 205 
may include a Bluetooth enabled transceiver and communication port for 
communicating with other Bluetooth enabled devices such as network device 
102 over the designated operating frequency. In one aspect, I/O interface 205 
may be configured to, under the control of controller 204, communicate with 
server terminal 105 and marker integrated device 101. 

Display unit 207 in one embodiment may include a liquid crystal display 
(LCD), a plasma-type display, and the like, configured to display text or image 
data, or a combined text and image data. Furthermore, as discussed above, the 
input units 203 A, 203B may include spring-loaded type input buttons for 
operation by the user's finger, and integrated, for example, on the front panel of 
marker integrated device 101 for quick and convenient access by the user. In 
one aspect, input units 203 A, 203B may be integrated with the existing input 
buttons on marker integrated device 101 such as, for example, preset radio 
station buttons on an automobile radio. Furthermore, timer/clock 206 may be 
configured to provide actual time information or generate an elapsed time 
information depending upon the input command from the user under the control 
of controller 204. 

Figure 3 illustrates one embodiment of a network device of Figure 1 . As 
discussed above, network device 102 may include WAP enabled mobile 
telephones, i-mode telephones, and intemet access enabled PDAs which have 
integrated therein, in one embodiment, the various components discussed 
hereinbelow. Referring to Figure 3, network device 102 in one embodiment 
includes controller 301 coupled to storage imit 302. Also coupled to controller 
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301 are input unit 305, output unit 304, and I/O interface unit 303. In one 
aspect, I/O interface unit 303 may include a Bluetooth enabled transceiver and 
communication port for communicating with Bluetooth enabled devices under 
the Bluetooth communication protocol. More specifically, I/O interface unit 
303 may be configured to interface with marker integrated device 101 via 
connection 106 for data transfer under the Bluetooth wireless communication 
protocol, as well as wirelessly communicating with server terminal 103 using, 
for example, WAP protocol or i-mode communication protocol. 

Referring back to Figure 3, storage unit 302 may be configured to store 
data received from marker integrated device 101 as well as for storing data 
received from server terminal 103. Additionally, controller 301 may be 
configured to update data stored in storage unit 302 based on user input 
command via input unit 305. Furthermore, output unit 304 which may include a 
Liquid Crystal Display, a plasma display unit and the like, may be configured to 
display data such as communication progress status, data connection status, 
received and/or generated messages, and the like. 

Additionally, in one aspect, input unit 305 and output unit 304 of 
network device 102 may be integrated with the device input unit and output unit 
such that additional design modification to existing network devices can be 
avoided. For example, in the case of network device 102 including a WAP 
enabled mobile telephone, output unit 304 may be integrated with the existing 
display panel of the mobile telephone, while input unit 305 may be integrated 
with the existing numeric buttons provided thereon. 

Figure 4 illustrates one embodiment of a server terminal of Figure 1. 
Referring to Figure 4, server terminal 103 includes controller 401, input unit 
402, display unit 403, RAM/ROM 404, storage unit 405 and I/O interface unit 
406. As shown, controller 401 is coupled to input unit 402 and display unit 403 
for receiving input signals and controlling the output display, respectively, of 
server terminal 103. Controller 401 is further configured to access RAM/ROM 
404 to retrieve data stored thereon for performing executable processings while, 
controller accesses 405 storage unit 405 to retrieve data such as user playlist 
data, user account information, playlist information, and the like based on data 
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marks received as discussed in further detail below. 

In one aspect, I/O interface unit 406 is configured for wireless 
communication with, for example, network device 102 such that server terminal 
103 may transmit and receive data under wireless communication protocol to 
network device 102. Furthermore, in one aspect, controller 401 may be 
configured to encrypt and decrypt data transmitted and received from network 
device 102 under wireless communication charmel such that data may be 
securely transmitted and received. 

Moreover, as discussed above, server terminal 103, under the control of 
controller 401 may be configured to communicate with user terminal 105 via 
data network 1 04. Depending upon the type of data received from user terminal 
105, controller 401 may be configured to selectively access storage unit 405 to 
retrieve information stored thereon in response to the received data, or to update 
the stored data in storage unit 405 based on the received data. Additionally, 
controller 401 may be configured to receive play list information from play list 
provider (not shown) periodically, or at predetermined time frames, and to store 
the received play list information in storage unit 405. 

Figure 5 is a flowchart for illustrating one embodiment of the embedded 
data marker device communication system operation. Referring to Figure 5, at 
step 501, a user inputs data marks using input units/buttons 203 A, 203B of 
marker integrated device 101 for bookmarking data such as desired music clip 
broadcast over a registered radio or television station. After one or more input 
data marks, data marks and user device ID are transmitted to network device 
102 via wireless Bluetooth connection 106. As will be discussed in fixrther 
detail below, network device 102 may then be configured to establish wireless 
connection to server terminal 103 for transmitting received data marks and 
user's device ID. 

Referring back to Figure 5, at step 503, the user transmits account login 
information from user terminal 1 05 to access user's account at server terminal 
103. It should be noted that in one embodiment, a substantial time lag exists 
between step 502 of transmitting data marks and device ID to network device 
102 and step 503 where user's account login information is transmitted from 
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user terminal 105 to server terminal 103 via data network 104. Thereafter at 
step 504, information corresponding to transmitted data marks are received at 
user terminal 105 from server terminal 103, where the data marks were 
transmitted from marker integrated device 101. Finally, the user may logoff the 
user's account at step 505, completing the procedure. 

In this manner, using marker integrated device 101, users may 
conveniently bookmark data such as broadcast music clips over registered radio 
stations and television stations, and wirelessly transmit the marked data 
relatively contemporaneous to storing (or inputting) data marks in marker 
integrated device 101, and thereafter, via user terminal 105 such as a personal 
computer and the like, retrieve information corresponding to the marked data 
such as, in the case of marked broadcast music clips, information related to the 
marked music clips including the name of the music album, the name of the 
artist of the marked music clips, the purchase information for the purchase of 
the music album, and the like. 

Additionally, since the functionality of the electronic data marking 
device is integrated into electronic devices such as car radios, portable music 
playback devices which are further enabled for wireless communication with 
network device 102, a much robust data marking system is possible. 

Figure 6 is a flowchart for illustrating another embodiment of the 
embedded data marker device communication system operation. Referring to 
Figure 6, at step 601, data marks and device ID are received by network device 
102 from marker integrated device 101 via wireless connection 106. Thereafter 
at step 602, network device 102 is configured to establish connection to server 
terminal 103 which may be over a wireless communication data path such as 
connection 107. At step 603, with the connection established between network 
device 102 and server terminal 103, network device 102 is configured to 
transmit data marks and device ID information received from marker integrated 
device 101. 

Once data transmission from network device 1 02 to server terminal 1 03 
is completed, at step 604, network device 1 02 receives a transmission complete 
message from server terminal 103, and thereafter, at step 605, terminates the 
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connection to server terminal 103. After terminating the connection to server 
terminal 103, network device 102 at step 606 displays transmission completed 
message received from server terminal 103 on output unit 304 (Figure 3) which 
in one embodiment may include a display unit such as a liquid crystal display 
unit, a plasma display unit or the like. In this manner, the user may 
conveniently be informed as to the transmission status, and the completion of 
data transmission to server terminal 103. 

Additionally, network device 102 may be configured to transmit 
transmission completion message to marker integrated device 101, which, upon 



receiving the transmission completion message, may be configured to delete the 



transmitted to network device 103 for transmission to server terminal 103, such 
that marker integrated device 101 need not be designed with a large capacity 
memory for storing a significant number of data marks, and further, frequent 
transmission of marked data is possible without the need to use a gateway 
terminal (for example, user terminal 105) for transmitting marked data. 

Figure 7 is a flowchart for illustrating a further embodiment of the 
embedded data marker device communication system operation. Referring to 
Figure 7, at step 701 user inputs desired data marks in marker integrated device 
101, and at step 702, the inputted data marks are transmitted to network device 
102 along with user device ID. Thereafter at step 703, network device 102 
establishes connection to server terminal 103. With the connection to server 
terminal 103 established, network device 102 initiates data transfer to server 
terminal 103, the transmitted data including received data marks and device ID, 
for example. At step 705, it is determined whether the data transmission from 
network device 102 to server terminal 103 is completed. If the data 
transmission from network device 1 02 to server terminal 1 03 is not completed, 
then the procedure returns to step 704. On the other hand, if at step 705 it is 
determined that data transfer from network device 102 to server terminal 103 is 
completed, then at step 706 network device 1 02 terminates its connection with 
server terminal 103. Optionally, network device 102 may encrypt data for 



stored data marks to allow the user to input additional-data marks. In this 
manner, data marks stored (or input) to marker integrated device 101 may be 
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transmission to server terminal 1 03 prior to executing data transfer, in this case, 
server terminal 1 03 may be configured to decrypt the encrypted data received 
from network device 102. 

Referring back to Figure 7, after terminating the connection to server 
terminal 103 at step 706, at step 707, netv^ork device 102 is configured to 
display a transmit acknowledgement message on its output unit 304 (Figure 3) 
to inform the user that the data transmission to server terminal 103 is 
completed. Alternatively, network device 102 may be configured to transmit a 
message to marker integrated device 101 via Bluetooth connection 106, and 
marker integrated device 101 may be configured to delete the stored data marks 
upon receiving the message from network device 102. In this manner, the user 
may operate marker integrated device 101 to input additional data marks as 
desired. 

Referring again to Figure 77, at step 708 after receiving data from 
network device 102 and disconnecting its connection thereto, server terminal 
1 03 is configured to retrieve information from storage unit 405 (Figure 4) 
corresponding to received data marks. For example, in the case of bookmarked 
music clips as data marks, server terminal 103 may be configured to query 
storage unit 405 to identify the corresponding music information for each data 
mark received from network device 102. Furthermore, server terminal 103 may 
be configured to retrieve user account information based on device ID received 
from network device 102. 

Thereafter at step 709, when server terminal 1 03 detects a user login 
from user terminal 105 via data network 104, at step 710, server terminal 103 
may be configured to transmit the retrieved information corresponding to the 
received data marks from network device 102, and to display the transmitted 
information at user terminal display unit. Altematively, server terminal 103 
may be configured to access storage unit 405 only after detecting the user login, 
and to retrieve stored information corresponding to the received data marks for 
transmission to user terminal 103. 

In the manner described above, in accordance with the various 
embodiments of the present invention, the functionality of electronic data 
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marker device such as electronic music marker devicess may be integrated with 
electronic devices such as car radios, portable audio playback devices, and the 
like. Moreover, these electronic devices may also include a Bluetooth 
communication port and transceiver for wireless data communication with 
devices with such communication ports such as network devices including, for 
example, WAP enabled mobile telephones, i-mode telephones, internet access 
enabled PDAs and the like. In this manner, bookmarked data may be easily 
transferred to the network devices, which, in turn, may be configured to 
wirelessly access the server terminal for transmitting the bookmarked data. 

Moreover, users may access their electronic music marker device 
accounts to retrieve bookmarked music clips and related information such as 
music CD purchase information from user terminals connected to the server 
terminal. In this manner, electronic music maker integrated device 
communication system allows users to bookmark music clips broadcast from 
registered radio and television stations, arid wirelessly transmit bookmarks as 
well as users' unique device IDs via network devices such as mobile telephones 
to server terminal, and thereafter, conveniently retrieve information related to 
the bookmarked music clips by accessing their respective electronic music 
marker device accounts. 

Various other modifications and alterations in the structure and method 
of operation of this invention will be apparent to those skilled in the art without 
departing from the scope and spirit of the invention. Although the invention has 
been described in connection with specific preferred embodiments, it should be 
understood that the invention as claimed should riot be unduly limited to such 
specific embodiments. It is intended that the following claims define the scope 
of the present invention and that structures and methods within the scope of 
these claims and their equivalents be covered thereby. 



